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^ •  INTRODUCTIOM 

Throughout  history,  searching,  on  one  foriu  or  another 
has  been  one  of  loan's  constant  endeavors.  "■  jhistor  .c  man 
hunted  for  his  /rood,  both,  plant  and  animal.  The  more 
successful  searchers  understood  the  characteristics  of  their 
query  and  search  area.  They  could  then  ell  .inate  some  e  aas 
from  consideration  and  concentrate  on  others.  i.v,_  example- 
if  certain  plants  only  grew  in  the  shade,  open  fields  would 
oe  eliminated,  from  the  search  area. 

In  searclies  involving  people,  this  characteristic  ini  .5r- 
mation  can  be  exploited  by  both  the  searcher  and  his  quary 
(the  evader)  .  If  Line  evader  )cno\.s  the  tendencies  of  the 
searcher,  he  can  take  the  appropriate  actions  to  reduce  his 
chances  of  being  found.  The  knowledge  of  an  adversary's 
action  (intelligence  in  military  terras)  is  alwav"  sought  to 
give  one  side  an  advantage.  Certainly  the  submarine  commanaer 
want-s  to  know  where  the  convoy  wil.l  transit,  just  as  much  as 
the  convoy  corurrvander  wants  to  know  where  tiie  suhmarii  '  will 
hunt  [Ref.  li- 

We  can  sec  that  :o  fail  into  patterns  of  searching  (or 
evading)  is  analogous  to  providing  the  other  pa,rty  witii 
information  that  he  ca,n  exxsloit.  Since  a  pattern  or  deter¬ 
minant  strategy  provides  iiiformation  to  the  adversary,  it  is 
only  logical  not  to  be  predictable.  Therefore,  the  searcher 
and  evader  should  be  unorediccable ,  or  .random,  in  th.ei.r  choice 


of  search  actions.  Search  patterns  that  are  random  do  not 
yield  repeatable  re.sults  from  each  trial  but  certain  quanti¬ 
ties  such  as  the  probability  of  detection  are  amenable  to 
mathematical  calculation. 

Each  time  the  searcher  faces  a  choice  with  a  known  set 
of  conditions,  he  should  choose  his  action  randomly  to  avoid 
falling  into  a  pattern.  If  the  search  action  was  repeatable, 
the  same  choice  would  be  repeated  each  time  and  hence  a 
pattern  would  develo 

A  prime  quantity  of  interest  in  a  search  is  the  probability 
of  detection  (POD)  .  The  pz'obability  of  detection  is  a  measure 
of  effectiveness  (MOE)  of  the  search.  The  basic  problem  is 
to  compute  this  MOE.  The  next  step  is  usually  to  optimize 
the  probability  of  detection.  Optimize  means  maximize  to 
the  searcher  and  minimize  to  the  evader.  Occasionally  other 
piece.s  of  information  are  required  such  as  the  probability  of 
detection  under  an  extreme,  or  most  probcible,  set  of  conditions. 

This  paper  will  explore  the  problem  of  one  or  more  search¬ 
ing  units  searching  for  a  single  evader.  It  is  assumed  that 
neither  party  has  tendencies  that  may  be  exploited  by  the 
other  to  predict  his  actions.  The  actions  of  the  searcher 
and  evader  are  random  in  that  act  _on3  or  choices  are  not, 
predict ab ie . 

A  border  search  problem  will  be  deveicpea  initially.  The 
probability  of  detection  is  def.i.ned  and  a  c;:;)Ok.!  e  cutter  mode  L 
IS  introduced.  The  searcher  has  tv,’0  search  units  with 
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different  capabilities  attemptinc  to  detect  a  single  evader. 
Following  this,  a  more  complex  problem  is  addressed.  Two 
search  units  of  different  capabilities  attempt  to  detect  a 
single  evader  in  an  area  which  is  partitioned  into  two  pieces. 

The  area  search  problem  is  then  addressed  as  a  two  person 
zero  sura  game.  Each  entry  in  the  payoff  matrix  is  the  proba¬ 
bility  of  the  searcher  detecting  the  evader  for  the  strategies 
picked  hy  each  player.  The  optimal  probabilities  of  playing 
each  strategy  are  computed.  The  expected  value  results  of 
the  game  indicate  that  all  pairs  of  search  strategies  yield 
the  same  expected  value  of  the  game.  The  choice  of  strategies 
is  made  based  upon  minimum  variance.  The  search  area  is 
then  partitioned  into  three  pieces  and  an  example  is  presented. 

The  concept  of  random  search  is  next  introduced.  The 
evader  is  allowed  the  latitude  of  moving  within  the  operating 
areas.  The  problem  Is  modeled  as  a  game  and  the  expectation 
and  variance  are  computed.  In  the  case  of  random  search,  the 
pair  of  strategies  of  the  searcher  which  yield  the  largest 
expected  value  of  the  game  would  be  chosen  for  the  search. 


II.  THE  NATURE  OF  THE  SEARCH  PROBLEM 


Sea:::;i  units  are  generally  constrained  by  range,  speed, 
endurance  or  other  restrictions  such  as  hours  of  daylight 
available.  The  tijrie  and  speed  constraints  can  be  combined 
into  an  effective  range^  of  the  searching  unit.  If  there  are 
two  units  available  to  search  a  region,  it  is  logical  to  want 
to  find  the  best  way  to  partition  the  region  to  optimize  the 
search.  Two  partitioning  problems  will  be  addressed  in  this 
section.  The  fir.st  is  the  search  of  a  border.  The  second 
problem  is  that  of  searching  an  area.  Under  certain  conditions 
and  constraints,  the  area  searching  problem  can  be  reduced 
to  tho  same  -nathematical  form  as  the  border,  or  lane  searching 
problem. 

A.  BORDER  SEARCHING  PROBLEM 

We  consider  the  problem  of  insurgents  or  smugglers  attempt¬ 
ing  to  cross  a  border  such  as  a  riv'^vr  or  an  international 
boundary.  The  border  mast  not  necesr trily  be  straight  but 
we  require  that  it  does  not  havC'  extreme  cuj  vature  or  corners. 
We  defi.ne  the  person,  or  uiij,.t,  att euipt:. mg  to  cross  the  border, 
33  trie  evadt^r.  Let  the  patroLiiiu;  uercou,  or  unit,  be  de  lined 
as  Che  st?archer.  We  wili  assume  that  the  border  is  very  loiiq 


A\'  e 


;i  c,  II 


so  that  at  any  time  the  searcher  cannot  observe  the  entire 
length  of  the  border,^ 

The  objective  of  the  evader  is  to  cross  the  border  with¬ 
out  being  detected  by  the  searcher.  The  searcher's  objective 
is  to  detect  the  evader  when  he  attempts  to  cross  the  border. 
A  detection  can  only  occur  when  the  evader  appears  in  the 
field  of  view  of  the  searcher's  tensor.  The  sensors  could  be 
acoustic  (sonar)  ,  electromagnetic  (radar)  ,  or  optical  (inj'ra- 
red  or  image  enhancing  devices).  Of  course,  the  human  eye 
is  the  sensor  we  are  all  most,  familiar  with. 

The  searcher  and  the  evader  have  diametrically  opposatl 
views  of  success  and  failure.  The  searcher  considers  the 
detection  of  the  evader  a  success  while  the  evader  calls  it 
a  failure.  If  the  evader  is  not  detected,  he  considers  that 
a  success,  while  the  searcher  considers  it  to  be  a  failure. 
The  searcher  and  evader  can  both  observe  the  same  set  of 
events  and  reach  opposite  conclusions  about  success  and 
failure . 

Consider  the  following  model  of  the  border  search  problem 
in  Figure  1.  This  model  is  applicable  while  the  searcher  is 
actively  on  station  searching  for  evaders  crossing  the  bo  ier. 
The  evader  is  attempting  to  cross  the  border  into  friendly 
uorritory.  The  probability  of  detection  is  1.0  if  the  evader 
passes  within  the  swee[  width  W,  otherwise  it  is  0,0„  It  is 


-] 

''The  towers  of  the  great  waL!  of  Oiina  were  cons 
so  the  entire  length  of  the  border  could  bo  viewed  s 
taneously  bv  many  observers. 


t:  I'uct  ed 
i  j  v.ui  - 


assmned  that  the  border  length  S  is  much  greater  than  the 
sweepwidth  W..  The  searcher  travels  at  speed  V  along  the 
border.  The  evader  is  equally  likely  to  cross  anywhere 
along  the  length  of  the  border.  The  searcher  traverses  the 
border  in  one  direction  for  tlie  duration  of  his  endurance. 

It  is  necessary  to  state  some  further  assumptions  and 
consequences  of  the  model.  We  assume  that  the  searcher  has 
a  much  greater  sweepwidth  than  the  couriterdetection  range 
of  the  evader.  Therefore,  no  evasive  action  may  be  taken  by 
the  evader.  In  addition  there  can  be  no  missed  detections 
or  false  alar-ms.  The  evader  can  only  be  detected  when  he 
falls  within  the  sweep^>?idth  of  the  searcher's  sensors. 

The  evader  approaches  the  border  at  speed  U,  and  at  an 
angle,  9,  The  searcher  travels  at  speed  V  along  the  border. 

We  choose  an  orthogonal  coordinate  system,  perpendicular 
( |_)  and  parallel  (//)  to  the  border  (see  Figirre  2)  and  resolve 
the  speed  of  the  searcher  ana  evader  into  components  in  this 
coordinate  system. 

When  the  evader  crosses  the  border,  he  must  travel  the 
distance  L  -  W/cos  0,  in  which  he  i.s  subject  to  detection. 

The  evader  tt averse.  >  L  in  time  t,  where: 


t;  Si 


ot  tilt;  -.^vatler  pe  rp 


vv 

IS  0 

U. /U 

Vi? 

u'  ” 
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that',  on '  y  t,! 

:"ie  velocity 
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Vi  1  a.r 

t  o  t.ho  bfvri 

'lev.  enters  i 
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Coordinate  system  parallel 
and  perpendicular  to  the 
searcher's  direction  of 
travel 


Figure  2o  Evader  Attempting  to  Crops  Border 


.  ..  1^. 
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time  to  traverse  the  sweep  width  band.  It  is  apparent  that 
the  evader  should  not  be  exposed  to  possible  detection  any 
longer  than  necessary.  The  evader  does  not  know  the  searcher' 
direction  of  travel  along  S.  The  speed  component  U  should 
be  as  large  as  possible  to  minimize  the  time  to  cross  the 
border.  This  occurs  when  the  evader  crosses  perpendicular 
to  the  border.  Under  these  conditions  9  --  0 ,  «  U  and 

U]jj  ^0.  In  all  subsequent  developments,  the  evader  will 
cross  the  border  in  the  most  advantageous  manner  i.e., 
perpendicular  to  the  border. 

The  searcher  is  not  allowed  to  cover  a  portion  of  the 
border  that  he  has  already  tr.uversed,  and  only  travels  in 
one  direction.  However,  he  may  come  to  the  end  of  the  border 
before  he  has  exhausted  his  search  time.  We  can  prevent  this 
from  happening  by  requiring  that  the  searcher  always  begin 
his  search  at  least  +  W/2  from  eitJier  end  of  the  border 
If  he  moves  toward  the  end  of  the  border  for  time  T  at  speed 
he  IS  still  W/2  av?ay  from  the  end  when  he  finishes  the 
search,  where  W/2  is  the  search  radius. 

The  measure  of  effectiveness  in  this  problem  has  been 
chosen  to  be  the  probability  of  detecting  the  evader.  It 
may  be  possible  to  determine  the  probability  of  detection 
experimentally.  The  initial  conditions  of  a  seax'ch  would 
ue  determined  for  the  searcher  and  the  evader.  The  evader 
•would  select  from  a  uniform  distribution,  a  point  where  to 

cross  the  border.  The  searcher  would  seilect  frrjni 


L  6 


attempt  to 


a  uniform  distribution,  where  to  start  his  search  within  the 
interval  VT  +  W/2  from  each  end  of  the  border.  Then  with  a 
flip  of  a  fair  coin,,  he  would  decide  which  direction  in  which 
to  traverse  the  border.  A  series  of  these  trials  would  be 
conducted  and  the  number  of  detections  would  be  recorded. 

The  probability  of  detection  would  be  estimated  from  the 
ratio  of  the  number  of  detections  to  the  number  of  trials. 

The  above  procedure  could  be  accomplished  more  easily  in  a 
simulation  than  in  a  physical  experiment.  A  more  appealing 
alternative  is  to  compute  the  probability  of  detection  directly. 

For  a  given  evader's  speed  U,  the  effectiveness  of  the 
searcher  is  a  function  of  his  speed  V,  the  sensor  sweepwidth 
W  and  the  bord^^ir  length  S.  The  probability  of  detection  is 
only  defined  if  the  evader  is  present.  The  search  speed, 
sweepwidth  and  length  of  border  alone  are  not  enough  to  de¬ 
fine  the  probability  of  detection,  though  some  information 
is  available  by  taking  the  ratio  of  sweepwidth  and  border 
length.  This  coverage  factor,  W/S,  is  one  measure  of  the 
searcher's  capability. 

If  the  searcher  could  traverse  the  entire  border  during 
tile  increment  of  time  that  the  evader  was  attempting  the 
crossing,  the  evader  would  surely  be  detected.  If  t.he 
searcher  were  stationary,  the  evader  would  certainly  not  be 
detected  unless  he  crossed  the  border  in  the  fiela  of  view 
of  the  statiojiary  sensor  of  the  searcher.  In  the  first  case, 
the  probiiij  il  ity  of  detection  is  L.O  and  in  the  second  case. 


it  is  equal  to  the  coverage  factor,  W/S In  the  problem 
under  consideration,  some  part  of  the  total  lengtli  of  the 
border  is  traversed  by  the  seaircher  during  the  time  that  it 
takes  the  evader  to  make  his  crossing.  The  probability  of 
detection  is  defined  to  be  the  ratio  of  the  length  of  the 
border  searched,  R  (in  the  time,  interval,  t,  that  it  takes 
the  evader  to  cross  the  border) ,  to  the  length  of  the  border, 
S.  This  is  the  probability  of  detection  given  the  evader  is 
crossing  the  border  S,  i.e.,  P0D|S.  Here, 


POD  S 


R 

S 


W  +  V*t 


W  +  V*W/U 

s 


(2) 


where  U  >  0 ,  V  ^  0 . 

Rearranging  terms,  the  following  expression  for  the  proba¬ 
bility  of  detection  results: 


PCD  S  = 


W  /I  ^  V. 

s  ^  ' 


(3) 


where  U  >  0 ,  V  >  0 , 

In  Equation  (3) ,  W/S  is  the  coverage  factor.  Consider 
the  example  where  the  searcher's  speed  is  V  =  0,  such  as 
when  he  occupies  a  watch  tower  on  the  border.  If  the  evc\der 
crosses  within  his  field  of  view,  W,  he  is  detected.  Even 
with  no  speed,  there  still  would  be  a  fx.nite  POD.  The  ratio 
of  speeds  in  the  second  term  represe.n.ts  the  increase  in  the 
proba,biXity  of  detection  due  to  the  speed  of  the  searcher. 
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This  ratio,  V/U,  may  be  interpreted  the  dynamic  enhance¬ 
ment  of  the  static  probability  of  detection  [Ref.  2]. 

Wg  will  now  determine  the  upper  boutid  on  the  POD|s. 
Figure  3  shows  the  allowable  interval  in  which  the.  searchet 
may  begin  his  search. 


}«f~  VT+W/2*i*-“~-  Interval  to  start  search  - - 4^  VT+W/2  **( 

- - - J - - - - - - - - - - - - J - - - — - - - 

[, - 


Border  Length  S 


Figure  3.  Interval  c.o  Start  Search 

During  the  interval  t  that  the  evader  is  crossing  the 
border , 


S  >  2(vt  ±  W/2)  . 


(4) 


Rearranging  terms  yields 


,  2vt  .  W 

1  ^  — = —  +  — , 


Recall  that  t  =  W/U  and  substitute  into  b,  yieldin-.? 


2W  ,  W 
^  ^  S' 


W, 


1  -  id  2 
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Sincri 


pod|  s 


^(1  -f 

s' 


r 


we  have 


1  > 


^(1 


avs 


(5) 


axui 


PODjS  <  1. 

If  we  examine  the  probability  of  detection  (Equations  2 
and  3)  we  raay  confirm  some  intuitive  ideas  about  searching. 

The  POD  is  greater  if  the  searcher  can  see  farther  (greater 
sweepwidtb j  W)  or  cover  nore  ground  in  a  given  time  (greater 
speed,  V) .  The  probability  of  detection  is  less  if  the 
evader  can  cross  the  border  mere  quickly  (greater  speed,  U) 
or  operate  along  an  expanded  h:irder  (i,e.,  increased  S)  . 

B.  TWO  SE..\RCKIKG  UNITS  ON  THE  BORDER 

In  this  section  we  will  a-surtie  that  there  are  two  searchers. 
Unit  1  eind  Unit  2  searching  f  ir  a  single  evader  crossing  the 
b-:  rder.  Each  search  unit  has  a  diffe:rent  sweepwidth  (W^  and 
and  speed  yV and  .  The  spvecd  of  the  evader  i5^  U. 

The  ranges,  R,  and  that  represent  the  search  capability  of 


each  unit  while  the  evader  is  crossing  the  border  can  be 
easily  compVitedo  Here: 


''1 

Rl  =  'v  1  +  -j~)  atnd 

^2  ~  ^2  ( 1  +  -^) 


(6) 


These  eguatiisns  are  of  the  same  form  as  the  numerator  in 
Eqv^ation  (2)  . 

It  is  reasorable  to  have  soirie  rationale  for  the  division 
of  labor  betwessn  the  two  searching  units.  Suppose  that  v;e 
partition  the  border  lengtli,  S,  into  two  pieces  of  lengths 
and  82^  where  ^2  =  S.  We  assign  Unit  1  to  i;he  length 

of  border  S,  and  Unit  2  to  length  of  border  S_ ,  as  shown  in 

^  4U 

Figure  4, 

The  probabilities  of  detection  of  Unit  1  and  TJnit  2  (in 
S-|  and  S_  respectively)  ar-.-; 

Jm  *L 


PODiiSi 


POD^ 


and 


(7) 


The  probability  of  detecting  the  evader,  P(Det) ,  is  the 
t.  G  t  a  1  p  r  ofc  ab  i  I  i  t  y  ,  i  .  e  .  , 


P  t  De  t 


p  (  Dec  I  S 


r' 


JCt 


* 


\  r  } 


where : 


P(3.)  =•■  Probability  the  evader  will  cross  the 

border  in  segj’nent  3.,  i  =  1,2. 

X 

Since  the  evader  is  assumed  to  be  equally  likely  to 
cross  tJhe  border  anywhere  along  its  length. 


P(S. ) 


(9) 


Nov/,  reducing  Equation  (8)  using  Equations  (7)  and  (9)  gives: 


R, 


S. 


P ( Det ) 


^1  ^1^^2 


^1^^2 


Rl+R^ 

S,^S2 


R 

S' 


(10) 


where: 


R, +R^  =  R  -  the  total  non -over lapping  length  of 
^  the  border  patrolled  by  the  two 

search  'on its  . 

The  implicit  idea  in  partitioning  the  border  was  to  do 
it  in  3uch  a  way  that  the  probability  of  detection  v/as  opti¬ 
mized.  We  see  from  the  form  of  Equation  (10)  that  the  par¬ 
titioning  of  the  border  into  two  individual  segments  has  no 
effect  on  the  overall  pirobability  of  detection.  This  is  the 
result  of  the  evader  oeing  equally  liKely  to  cross  the  border 
at  any  point  aionq  its  length,  and  of  not  ail>.jwiiig  any  overia}. 
O'y^  t,iie  seai'ch  units. 


C.  TWO  SEARCTIING  UNITS  IN  AN  AREA 


The  next  logical  extension  of  the  searching  problem  is 
to  search  an  area  instead  of  a  border.  We  will  consider  two 
search  units  in  an  area,  searching  for  an  evader  who  is 
operating  at  a  fixed  location.  If  the  area  swept  -by  a 
search  unit's  SvSnsor  contains  the  evader,  there  is  a  detection. 
Otherwise  there  is  not. 

The  following  information  describes  the  capabilities  and 
constraints  of  a  searching  unit: 

V  =  Search  speed, 

T  =  Searching  time, 

W  =  Sweepwidth  (POD  of  the  evader  =1.0  within 
W,  zero  otherwise) ,  and 

ttW^ 

a  =  Area  searched  --  WVT  +  (in  time  T)  . 

In  Figure  5  we  see  that  the  area  swept  (searched)  in  a 
time  interval  T  by  the  searcher,  consists  of  displacing  the 
initial  sweepwidth  circle  a  distance  VT .  If  the  search  time, 

9 

T ,  is  sufficiently  large  such  that  WVT  •  then  the  area, 

a,  can  be  approximated  by: 

a  VvVT.  (Li) 

We  L’i.ave  as.S'irat  d  that  the  evader  i;:  operating  at  a  sv’ecit  ii: 
'oiVjtion,  su>:h  as  a  field  headiiua  r  r  rs  ,  witfnni  na  area,  A. 

He  '.'Ll!  reiitaLr.  at  this  uin,  ^ind  eaniu)t,  laove  t'o  ivtiLa 

tlu-  :;t'a  r  ciie  r .  We  iXMitinue  to  invokt  t  fie  ■  >  incipie  oi 


4 


randominess .  This  means  that  the  searcher  does  not  Know 


where  to  search  for  the  evader  nor  does  the  evader  know  where 


W  =  dweepwidth 
V  =  Searcher  *  s  Speed 
T  =  Time  Searching 


Figure  5.  Total  Area  Searched 


the  searching  lanits  will  look  for  him.  Further,  we  assun^e 
that  the  evader  is  equally  likely  to  be  anywhere  within  the 
area  when  the  searcii  is  initiate^d  and  the  searcher  is  equally 
likely  to  begin  searching  at  any  point  within  the  area.  The 
searcher  then  begins  the  search  with  the  objective  of  detect¬ 
ing  the  evader. 

The  measure  of  effectiveness  of  the  searciier  is  the  proba- 
biLity  of  detection,  POD.  The  searchvir  would  like  to  exhaus- 
t.i.vely  cover  the  whole  area  and  if  he  vJid  the  POD  would  be 
l.O.  Otbei  ;ise  the  POD  is  the  ratio  oi  the  area  searched, 
i,  to  Lise  total  area  A,  or 


\  ' 


Ptd.'  i  A 


Figure  6  shows  a  rectangular  area,  A  =  hS ,  which  may 
contain  the  evader  and  the  area  a  covered  by  a  searching  unit 


1 

An  area  searching  problem  involves  two  dimensions.  Under 
some  circumstajices ,  we  can  fix  one  dimension  of  the  rectangle 
and  only  have  the  other  one  variable.  For  example,  if  we 
were  searching  for  an  airplane  that  flew  over  water  along 
a  track  ten  miles  from  ±he  coast,  we  may  search  out  to  cea 
as  far  as  twenty  miles  along  some  length  of  coastline.  Thus, 
we  have  fixed  one  side  of  cur  search  rectangle  but  the  other 
dimension,  along  the  Coast,  would  still  be  chosen  to  reflect 
realistic  bounds  on  the  problem.  We  now  substitute  the  total 
search  area  hS,  for  A,  into  Equation  (13),  whjch  yields: 

FODjA  =  j™  ^14) 

The  term  is  a  constant.  Now,  if  we  compare  Equation 
(14)  with  Equation  (4) ,  for  the  one  dimensional  border  search 
problem  we  see  that  the  mathematiciil  form  i.s  the  same. 

Now,  we  wiJ.  1  expand  the  problem  to  two  searchers.  Two 
searchers.  Unit  1  and  Unit  2,  with  different  sweepwidths , 
speeds  and  searcn  tiiaes  will  sweep  areas  and  respec- 
tiveiy.  Here, 

a  .  =  W  .  V .  t .  ,  i  1 , 2  ,  (15) 

i  I  i 

The  two  swept  areas  a.,  and  a,,  are  not.  allowed  to  overleip, 

•L 

and  of  course  must  be  within  t.he  .overa.!!  seiiooh  area,  A.  Tne 
searcn  a."'ea,  P- .  '.s  part.iti<?ned  i.nto  two  parts,  one  oi:  size 


set'rched  by  Unit  1  and  the  other  of  size  A2 
Unit  2,  so  thct 


searched  by 


A  =  +  A^. 


(16) 


It  is  assumed  that  the  evader  is  equally  likely  to  be 
at  any  point  in  the  search  area.  Therefore,  the  total  proba 
bility  of  detecting  the  evader  is; 


P (Det) 


a,  +  a.-, 

X  A  _  ci 

=  A' 


(17) 


where ; 


a|^  +  a2  =  a,  the  total  area  swept  out  by  both 
search  units. 

The  conclusion  in  the  area  search  is  analogous  to  the 
border  seaxch;  the  probability  of  detection  is  not  affected 
by  the  partitioning  of  the  search  area. 

We  have  found  for  this  problem  that  there  is  no  way  to 
partition  the  search  area  and  improve  the  probability  of 
detection.  The  POD  can  be  degraded'^  but  not  improved..  In 
the  next  section,  we  shall  nuodei  the  searcii  as  a  game  and 
exploit  the  fact  that  the  searcher  and  the  evader  have  cor ^ 
f  1  i  c  t  i  n  cy  go  a  I  s  . 

"  By  over  Lapping  search  areas,. 


-  ^  ^  •  'MODELING  THE  SEAJRCH  AS  A  GAME 

Up  to  mw,  the  irformation  that  we  have  obtained  is  that 
the  probability  of  detecting  the  evader  is  (aj^+a2)  /A 
regardless^  of  how  the  searcher  chooses  to  allocate  the  two 
searching  units.  We  will  now  &>:pand  the  problem  to  allow  the 
searcher  amd  the  evader  alternative  courses  of  action.  The 
partitioning  of  A  will  define  a  choice  for  the  evader.  He  must 
choose  to  locate  in  either  or  A2;>  and  thus  the  evader  has 
onJ.y  these  two  choices,  to  operate  (hide)  in  or  A2  •  The 
partitioning  of  the  search  area  also  provides  the  searcher 
with  alternative  courses  of  action  on  how  he  allocates  his 
resources . 

The  theory  of  games  is  useful  in  analyzing  conflicts  be¬ 
tween  opposing  parties  (Refs.  3,4].  The  two  players  in  this 
game  are  the  searcher  and  the  evader.  The  conflict  is  that 
the  searcher  v/ants  the  probability  of  detracting  the  evader 
to  he  high  while  the  evader  wants  it  to  be  low. 

A  game  matrix  is  constructed  from  the  outcomes  of  all 
possible  courses  of  action  of  the  two  piiyers.  We  have  assumed 
that  the  searcher  partitions  the  search  area.  A,  i.nto  two 
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action,  i.e.,  the  area  in  which  he  will  search.  The  only 
I'estriction  on  the  partitioning  of  A  is  that  each  of  the 


two  pieces,  Aj^  and  A2,  be  at  least  as  large  as  the  sum  of 
the  search  capabilities.,  and  searching  units, 

'lie  searcher  has  several  ways  that  he  can  allocate  his  two 
search  units  to  the  operating  areas.  The  four  alternatives 
of  the  searcher  that  involve  both  searching  units  are  pre¬ 
sented  in  Table  1  below.  The  entries  in  the  matrix  identify 
which  search  units  operate  in  each  of  the  two  areas,  and 

^2* 


TABLE  1,  POSSIBLE  STRATEGIES  OF  THE  SEARCHER 


Searcher 

Strategy  A^ 

— . . 


S,. 


A., 


Unit  1  Unit  2 


Unit  2  Unit  1 


Units  1  la  2  None 


None'  Units  1  &  2 


For  completeness,  the  evader's  strate9,Le,s  are  shown  in 


TaJaiei 


TABLE  2.  Possible  Strategies  of  the.  Evader 


Evader 

Strategy 


Locate  in  A-, 


(Not  A2) 


E, 


Locate  in  A. 


(Not  A^) 


This  situation  may  be  treated  as  a  two-person  zero-sum  game 
characterized  by  a  payoff  matrix  which  specifies  the  results 
of  all  possible  combinations  of  tlie  strategy  as  of  both  players 
In  our  case,  the  entri;es  in  the  payoff  matrix  are  the  proba¬ 
bilities  of  detection  of  the  evader  by  the  searcher.  For 
example,  if  the  evader  hid  in  A2  (Strategy  2)  and  the  searcher 
chose  his  strategy  (where  Unit  2  searches  A2  and  Unit  1 
searches  in  A^) ,  the  probability  of  detecting  the  evader 
would  be  a^/A^ .  If  the  evador  chose  his  strategy  E2  and  the 
searcher  chose  his  strategy  S^,.  the  probability  of  detection 
would  be  (aj^+a2)/A2.  In  garae  theory,  it  is  conventional  to 
present  the  payoff  matrix  with  favorable  payoff  to  the  row 
player.  The  probability  of  detection  is  a  measure  of  success 
01  the  searcher.  Therefore,  the  searcher  will  be  the  row 
player  and  the  evader  will  be  the  colioinn  pJayer..  The  payoff 
matrix  for  the  game  is  presented  below  in  Table  3.  It  is 
us  'ful  to  establish  a  hierarchy  of  the  payoff  quanx:  it  les . 


TABLE  3.  PAYOFF  MATRIX  FOR  TWO  SEARCHERS  ..  WITH  AREA  PARTITIONED 


EVADERS'  STRATEGIES 


S 


1 


Searchers 

Strategies 


S 


4 


We  will  call  the  more  capable  search  unit.  Unit  1.  This 
means  that  Unit  1  sweeps  more  area  than  Unit  2  during  the 
search,  i.e.,  aj^  >  32*  We  will  call  the  larger  of  the  two 

search  areas  ,  i.e.,  A^  >  A^ ,  We  lose  no  generality  with 

these  assumptions. 

We  will  examine  the  case  when  3j^/A^  >  a.j/A2  in  detail. 

The  second  case,  when  ''  analyzed  similarly. 

It  is  convenient  to  replace  the  entries  in  payoff  matrix 

(Table  3)  witli  the  symbols  in  Table  4  below.  This  will  be 
useful  Later  when  we  analyze  tihe  game. 


TABLE  4 


SYMBOLIC  PAYOFF  MATRIX 


E., 


a 


Y 


S,  Y  +  Y 


B  +  6 


^2 

Since  -^r—  >  — ;  a  >  6. 
A.  A- 


Since  >  ^21  a  >  y  and  6  >  8 


Since  ;  6  >  a  and  8  >  y. 


This  yields  the  following  hierarchy,  6  >  a  >  8  >  Y-  Also 
since  6  >  a  and  8  >  y ;  8  +  '5  >  a  +  y . 

Therefore , 


A. 


Ci  2^ 

A-, 


3  3 


and 


a,+a„ 


This  still  leaves  the  relationship  between  and 

(3^+82) /A2  unknown,  but  as  we  will  see  later  that  it  does 
not  affect  the  outcome  of  the  evaluation  of  tlie  game. 

We  will  now  consider  two  examples.  The  dimensions  would 
be  chosen  to  be  the  same  (e.g.,  sq.  kilometers).  They  will 
cancel  out  of  the  equations  for  the  probability  of  detection. 
The  import.ant  point  in  the  examples  that  follow  are  the  rela¬ 
tive  sizes  of  the  area  to  be  searched  and  the  available 
ability  to  search. 

Example  1.  Two  search  units  searching  for  one  evader  where, 

A  =  100,  A^  =»  60;  Ctnd  =  40; 

a  -  20,  =  15,  c.nd  a2  ~  5. 


Note  that 


a 


1 


a. 


2' 


A.^ ,  and 


A. 


^2 


Substituting  these  values  into  the  payot t  matrix  yields; 


15 


5 

W 


s 


2 


5 


15 

1(5 


s 


3 


5+15 


0 


s 


4  0 


5+15 

'W~' 
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Note  that  5  >  a+y  in  the  matrix,  l-e»,  .  It  is  more 

convenient  to  deal  with  a  matrix  of  integers  t'.van  fractions 
Therefore  we  multiply  each  entry  by  24.  This  scales  the 
value  of  the  game  by  a  factor  of  24  and  the  following  game 
a’.a t r  ix  res  ul t  s . 


E, 


0 


Example  2 .  Two  search  units  searching  for  one  evader 


where , 

A  ==  270,  =  150,  and  ==  12Q; 

a  ~  100,  =  60,  amd  -■  40. 

^1  ^2 

Z^gain,  note  that  a,  >  a- ,  A,  >  A„  and  ^ 

1/1  ^  A2 

Substituting  into  the  payoff  matrix  yields 


60 

40 

TSo" 

40 

60 

Ilcf 

40+60 

0 

3  > 

0 

40+60 

^4 

I20  ' 

We 

see 

here  that 

5  < 

a+7 ,  i . e , , 

60  100 

IITO'  '  TW- 
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We  will  evaluate  the  g.ame  accr  rdlng  to  the  minimax 
theorem.  This  dictates  the  manner  in  which  both  the  searcher 
and  the  evader  must  choose  their  strategies  and  the  value  of 
the  game  that  results  from  these  choices.  The  details  of 
evaluating  a  game  subject  to  the  conditions  of  the  minimax 
theorem  are  presented  in  Appendix  A. 

At  this  point,  we  may  solve  the  4x2  game  in  Tables  3  and 
4.  An  analytic  solution  is  prefer,  ed  but  is  not  possible  in 
an  Mx2  game  (where  M  >  2) .  We  can  solve  the  underlying  2x2 
games  analytically.  For  the  .Mx2  game,  we  would  resort  to  a 
graphical  solution.  This  requires  that  the  entries  in  the 
payoff  matrix  are  specified  nuaier real ly  or  at  iea.se  the 
hierarchy  of  the  ele'  ents  is  established.  The  examples  tire 
plotted  in  Figure  as  a  runction  of  the  evader's  strategies. 
For  either  game,  we  .  in  see  in  Figure  7  that  the  feuir  strate- 
liies  of  tl'ie  searcher  ail  intersect  at  a  sin.'ie  Ttu^ 


Example  2 


general  4x2  game  would  have  six  intersections  of  the  strate¬ 
gies  (4  things  taken  2  at  a  time)  .  There  are  only  tvjo  inde¬ 
pendent  strategies,  defined  by  a,  6,  y  <S  •  The  other  two 

strategies  can  be  constructed  from  the  first  two  by  elementary 
matrix  operations.  This  is  shown  in  Appendix  C. 

The  intersection  of  all  four  strategies  of  the  searcher 
are  at  the  same  point.  This  is  the  value  of  tiie  game  which 
is  (a^+a2) / (A^+A2) ,  as  expected. 

The  probability  of  detection  computed  as  the  value  of 
the  game  is  the  same  as  computed  previously  by  taking  the 
ratio  of  areas.  The  searcher  could  choose  any  of  his  four 
pairs  of  strategies  1-2,  1-4,  2-3  and  3-4.  If  he  plays  the 
strategies  optimally,  he  would  achieve  a  probability  of 
detection  equal  to  ( a.j^+a2)  /  f  A^+A,, )  . 

All  six  stibgames  are  analyzed  in  Appendix  B.  Two  of  the 
games  have  sadd '.epoints .  The  optimal  strategies  of  the 
searcher  a  ui  :?viri.er  ai'e  computed  for  the  remaining  four  games. 
Any  sirgJe  ,;ear<',h  is  a  Bernoulli  trial  which  results  in  either 
a  >i.vcci.3,s  or  a  fa  i  Lure.  When  both  players  choose  their 
■;?  trate-’ 1.  ■ 's  :H.>t  i  li'i.j  Ly,  the  exDected  value  of  the  probability 
oi  dt- :v  I  •:  1.  I  .;)U  i  .s  r,h<'  value  of  the  game. 

I  „  iS  .  ■i'O' , . :!  App*,ndi.x  B  that  tne  value  of  the  q.-iiT.es 
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t:  i, '  n  t  i  .1 1 


c.;  c 


fluctuation  of  the  results  in  3  and  4  where  the  values  may 
possibly  range  from  zero  to  3+5-  The  game  wi.th  Strategies 
1  and  2~  on  the  other  hand,  has  a  smaller  range  of  possible 
values ,  from  y  to  <5 . 

We  have  four  2x2  games  v/ith  the  s-ime  value.  In  accordance 
with  the  expectdt .L.on"varia,nce  principle  of  choice  for  deci¬ 
sions,  the  choice  of  which  set  of  strategies  to  use  for 
searching  should  be  based  on  the  minimum  variance.  By  choos¬ 
ing  the  alternatives  providing  minimmn  payoff  variance,  the 
risk  of  achieving  a  probabiliry  of  detection  substantially 
less  than  the  value  of  tlie  game-  :  z  minimizec.  A  similar 
argument  has  been  advanced  about  investment  portfolios  [Kef. 

5],  If  all  portfolios  have  the  same  expected  return  on  invest¬ 
ment,  the  portfolio  with  the  largest  variance  is  the  one  witJi 
the  greatest  risk.  Conversely  the  portfolio  witli  the  least 
variance  has  the  least  risk. 

If  we  look  at  the  combinations  of  strategies  in  Figure  7, 
we  can  see  that  searchers'  Strategies  1  and  2  vary  the  least 
witli  respect  to  the  expected  value.  Therefore,  we  may  select 
the  alternative  with  minimum  variance  by  inspection.  The 
computations  presented  in  'Xable  ">  this. 

One  result  of  modeling  the  search  as  a  game  is  that  it 
allows  us  to  compute  the  variance  as  well  as  the  expecc  sd 


value  of  tJie  search  strategies.  The  variance  computatio.o  of 
a  2x2  game  is  described  in  Appendix.  A.  The  va,riance  and 
s+'andard  deviation  for  each  of  -’x2  3i±>uaaies  n  the  cwo 


example.  3  is 


i  0 


shown  in  Tabic 


WiBLE  S.  VAiRIANCE  AND  STANDARD  DEVIATION  FOR  EACH  STRATEGY 


.’AIR 


Example  1  Example  2 


Strategy  Pair 

Variance 

Std.  Dev. 

Var  .lance 

Std.  Dev 

1-2 

-00875 

.094 

.003841 

.062 

1-4 

.015 

.122 

.01372 

.117 

2-3 

.02333 

.1,^3 

,03841 

.19  6 

3-4 

.0400 

.200 

.13717 

.370 

Value 

of 

Game 

.20 

.370 

A,  EXTENSION  TO  MORE  SEARCH  AREAS 

The  game  approach  to  searching  can  be  applied  to  problems 

involving  three  or  more  search  areas  and  searching  units. 

At  this  point  the  combinations  of  vJ'ays  to  seax'ch  become  very 

large.  For  s.xample,  if  there  are  nwo  search  units  and  three 

areas  to  search,  we  can  coimt  nine  ways  tc  put  the  two 

searchers  in  the  three  aieas  and  thus  nirie  pure  strategies 
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for  the  searc.her.  Tnis  would  lead  to  (.,)  =84  3x3  games  to 
analyze. 

One  simple  exaxnpxe  is  where  one  se  ..xching  unit  looks  for 
one  evader  in  one  of  three  different  regions.  This  is  s imxlax: 
t:o  frying  to  p.ick  the  v^falnut  3hel.l  theit  has  t  e  p?  a  hidden 
under  it.  Of  course  if  you  pick  the  right  a  ael  i  ae.trch  area) 


the  probability  of  detection  is  1.0.  The  payoff  matrix  for 
this  search  model  is  shown  below. 


E,  Ej  Ej 


'’ll  “  “ 


Sj  0 


Sj  0  0 


Using  the  method  in  Epstein  [Bef.  6]  for  finding  optimal 


P(Ej^) 


P(B2) 


P(E3) 


P(S3_) 


P(S2) 


PCS.^) 


we 

find 

0 

p 

*  22 

^33 

^11 

^22 

^22  ^33  ^ 

^33 

^1 

^11 

p 

^33 

^11 

P  0 

z  2 

P^.^  F-.  + 
22  j3 

^33 

^11 

p 

1 1 

p 

22 

^11  ^22  ^  ’•"22  ^'33  ^33  ^11 


P,.  F.  ,  P. 


and  V 


'p"  p  “’.i-p  p  4-P  P 
22  ^22  ^23  33  1 


T  f  p  =  p 

^11  22 


P33  =■  P,  and 


P  ( S  ^  ) 


P  (E  .  ) 
1 


■1  -  1.  ,  ,  J  . 
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then  the  value  of  the  gairie  =«=  P/3,  the  variance  =  P  '/B, 
and  the  standard  deviation  »  P/'/J,. 

The  searcher  and  evader  would  play  each  of  their  strata- 
gies  with  probability  1/3  and  achieve  a  probabil  /.ty  of  detec¬ 
tion  (payoff)  equal  to  1/3  of  what  it  would  be  a  a  any  of  the 
three  areas. 

If  P  »  1  (the  shell  gaiue)  tlien 

Probability  of  Finding  Pea  »  1/3  , 

Variance  of  Probability  =  1/3  , 

Standard  Deviation  ~  1//3  ^  and 

Value  of  Game  ±  Standard  Deviation  «  1/3  ±  1//T. 

We  have  analyzed  search  problems  involving  stationary  evaders 
using  game  theory.  It  is  possible  to  expand  beyond  2x2  games 
out  the  potential  combinations  of  strategies  grow  very  quickly. 
Next  we  will  address  searching  for  a  moving  target  which  we 
will  model  with  random  search.  We  vrili  continue  to  use 
game  theoiy  to  anal-yze  the  pvioclem. 


IV.  RANDOM  SEARCH 

The  concept  of  random  search  was  introduced  by  B.  Koopitian 
in  1946  [Ref.  1] .  In  random  search,  the  evader  may  move  into 
an  area  already  covered  by  the  searcher.  Therefore,  even  if 
the  searcher  covers  the  area  exhaustively,  he  iway  not  find 
the  evader.  By  repeatedly  covering  the  area,  the  POD  then 
gees  asymptotically  to  1.0.  This  model  for  the  POD  is  the 
exponential 

POD  =  1  ~  e“^/'^, 

where j 

a  =  Area  swept  by  search  unit,  and 
A  =  Area  in  which  evader  is  operating. 

The  POD  always  increases  with  increasing  coverage  in  the 
random  search  rtradel.  Random  search  always  gives  a  smaller 
value  for  the  probability  of  detection  them  the  ratio  of  areas 
model,  as  shown  in  Table  6. 

The  next  step  in  the  development  oi  the  search  problem  is 
to  allow  random  search  in  our  previously  developed  examples- 
The  evader  is  now  free  to  ;tK)ve  within  the  partitioned  area 
that  he  has  chosen  but  is  not  allowed  to  cross  the  partition 
between  and  .  VJe  continue  to  aKDdel  the  problem  v/ith  the 
four  searcher  stratevcies  previously  described.  The  entries 


TABLE  6.  DETECTION  PROBABILITY  COMPAiUSON 


a/A 

Random  Search 

Ratio  of  Areas 

.25 

..2212 

.2500 

.5 

.3935 

.5000 

1.0 

.6321 

1.0000 

1 

2.0 

.8647 

l.OOOC 

in  the  payoff  matrix  are  now  the  probabilities  of  detection 
using  random  search.  The  arguments  of  the  POO  are  the  and 
Aj  shown  previously.  The  general  form  of  the  4x2  game  matrix 
is  shown  below. 


l-e  -^/A, 


-a. 


1-e  “/A- 


1-e  ^/A, 


1-e  -"/A. 


-"  ( a  1  ta„ ) 

S3  1-e  ^  /A^  0 


" ( a. +a^ ) 

1-e  “  /A^ 


I 

In  the  ratio  of  areas  model,  once  the  area  is  covered, 
the  POD  =  1.0.  Additional  coverage  is  redundant. 


4  5 


Example  1 .  When  we  use  the  previous  values,  a.,  =  15,  a,,  =  5 

•<L- 

“60  and  A2  *  40,  we  obtains 


E. 


E. 


E, 


l-e~l/4  l-e“l/® 


.22120  .11750 


,  -1/2  ,  -3/8 

1-e  1— e 


S2  .07996  .31271 


S., 


0 


S3  .28347 


1-e 


-1/: 


.39347 


Example  2 .  Similarly,  we  use  the  values  a^^  »  60,  a2  *  40 , 
=“  150,  and  A.,  =*  120  to  obtain: 


E 


J. 


E. 


E ... 


,_^-l/3 


.32968  .28347 


.  -4/15  -1/2 

1-e  '  i-e  ' 


S2  .23407  .39347 


.48658  0 


l~e 


-5/6 


5  6  540 
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It  is  useful  to  consider  some  otheir  examples  using  random 
search  where  tlie  coverage  factor  is  greater  than  1.0.  The 
same  four  searcher  strategies  will  still  be  used  while  the 
parameters  a2/  and  A2  will  be  chosen  to  give  coverage 
factors  gz'eater  than  1.0. 

Example  3 .  A  »  500;  A^^  *  400;  A2  =  100 


a  « 

300;  a^  =» 

200 ;  a2 

=  100 

^1 

1  ^2 

2'  A2  = 

1  — £ 

1 

4'  A2 

=  2 

^2 

^1 

^2 

Si 

1-e"^ 

®1 

.  39  34  7 

,63212 

^2 

l-e-'/'' 

1  -2 

1-e 

S2 

.22120 

. 86466 

^3 

0 

.52763 

0 

^4 

0 

,  -3 
i-e 

^4 

0 

.95021 

Note  here  the  strong  coverage  of  A2 . 

Example  4 .  A  ~  500;  -  350;  -  150 

a  ==  200;  =  150;  “  50 


4  7 


3  ^2  1 


^2  1 


*1  H  3-  Aj^  7' 


12. 


E, 


E, 


E. 


S,  l-.e“3/7  ,^,-1/3 


S,  .34856  .28347 

1 


S2  1-e 


-«'l/7  .  .~1 


l“e 


S2  .13312  .63212 


S3  1-e"'*^^  0 


S3  .43528  0 


S4  0 


1-e 


-4/3 


S4  0 


.73640 


We  next  address  all  the  2x2  subgamea  in  each  example  and 

compute  the  value  of  the  game,  the  variance  and  the  standard 

deviation.  In  Example  3,  the  Sj^  game  now  has  a  saddle- 

point  since  the  hierarchy  of  the  elements  within  the  payoff 

matrix  have  changed.  The  data  i.s  presented  in  Table  7. 

We  see  that  the  random  search  results  are  different  than 

the  area  search  results.  The  expected  value  of  the  probability 

of  detection  in  Examples  1  and  2  is  lower  a.s  expected. 

According  to  gaate  theory,  we  would  choose  the  pair  of  .search 

strategies  which  yield  the  largest  expected  value.  In  ail 

cases  this  i.s  the  S.-S.,  pair.  Further,  we  can  see  that  this 

-i  z 

pair  of  strategies  has  the  smallest  variance.  We  also  .‘>00 
that  t.he  diminishing  returns  effect  of  random  searcn  r.ircviuces 
lower  expected  payoff  in  the  more  extreme  search  patterns. 
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TABLE  7:  EXPECTED  VALUE  AND  STAJiDARD 

DEVIATION  FOR  RAl^DOM  FEARCH  EXAMPLES 


100 

;  a=*  2C 

270; 

a=  100 

A=  500;  a=  300 

A=  500; 

a  =200 

A=«  60 

?  a=  15 

A=  150; 

a=  60 

A -400;  a  =200 

A=  350; 

a  =150 

A=  40 

;  a»  5 

A=  120; 

a»  40 

A»  100;  a=  100 

A=150; 

a=  50 

ExsH5^.le  1 

EXanple  2 

ExaJiple  3 

Exarple  4 

Sfcmfceg/ 

Pair 

Val. 

Std,  Dev. 

Val.  S^  d.  Ctev. 

Val.  Std.  Dev, 

Val.  Std.  Dev. 

Si’S^ 

,11767 

.076  67 

.30819 

.04281 

,43525  .13486 

. 32370 

.08756 

Sl-^4 

.17506 

,10038 

.30477 

,08057 

. 32023 

.10853 

S^**nD 

. 17172 

,12552 

.29638 

. 13589 

,38957  .25611 

.29450 

.21801 

16477  .154^ 


?.6i52  .26152 


,3?925  .33925 


27357  . 273:57 


V.  SUMMARY 


The  game  theory  approach  to  modeling  search  is  useful 
when  oixe  wants  to  gain  more  infoarmation  about  the  px'oblem 
than  the  probaJjility  of  detection.  If  each  alternative 
yields  tlie  sam*?  expected  value,  the  choice  among  alternatives 
would  be  based  upon  minimuiri  variance.  he  alternative  that 
yields  the  largest  6xpecte;d  values  would  be  chosen  by  the 
searcher,  if  tlie  expected  values  were  all  different.  In  some 
particular  applications  it  may  even  be  desirable  to  select 
the  alternative  wit’  the  largest  variance  or  some  function 
of  the  expected  value  and  variance.  The  user  can  learn  more 
about  the  potertial  outcomes  of  his  problem  by  examining  the 
results  oi  the  gaxae  model.  He  now  has  the  variance  available 
to  further  describe  the  outcome.  He  would  use  the  area  ratio 
or  random  search  model  (whichever  was  applicable)  for  the 
probaloility  of  detection. 

/ui  interesting  area  for  future  work  is  relacing  the  ex¬ 
pected  value  piadicted  by  game  theory  to  the  probability 
of  detection  determined  by  experiment,  since  experiments 
that  are  expensive  or  physical  situations  that  occur  i.nfre- 
quencly  don't  allow  for  many  repetitions. 

In  a  game  situation  the  outcome  is  determined  by  trie 
strategies  chosen  by  each  player.  It  would  be  interestinrj 
to  know  the  reiaticnship  betVi^een  the  outcome  of:  the  game  and 
t.he  vax'ia.nce  a'ld  the  probability  distributions  of  each  player 
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and  thair  variances,  and  the  number  of  times  that  the  game 
is  played. 

It  is  hoped  that  this  approach  to  search  using  game 
theory  is  useful  to  those  in  the  operations  research  com¬ 
munity  and  that  ir  may  stimulate  further  work  in  the  area. 


ilftnil  tlMUnn  llTi  *>  lit 
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APPENDIX  A 


GAME  THEORY  CALCULATIONS 

In  this  appendix,  we  will  develop  the  optimal  probabili¬ 
ties  for  tlie  searcher  and  evader  when  they  play  the  game 
according  to  the  ininimax  theorem.  We  will  also  compute  the 
value  of  the  game  whe.-’  each  player  uses  these  optimal 
probabilities  to  select  his  strategy. 

The  payoff  matrix  by  convention  is  the  payoff  of  tiie 
column  player  to  the  row  player.  Since  the  probability  of 
detection  is  a  positive  payoff  to  the  searc-her,  we  will  make 
the  searcher  the  row  player  and  the  evader  the  coluism  player. 
Another  common  convention  is  to  call  the  row  player  Blue  and 
the  column  player  Red.  We  will  use  the  terminology  of  the 
problem,  searcher  and  evcider. 

A  zero  sum  game  represents  an  exchange  between  two  player 
Whatever  the  cclumn  player  considers  to  be  detrimental,  the 
row  player  considers  to  be  beneficial  and  ^^ice  versa.  If  the 
payoff  matrix  represents  a  physical  exchange'  (of  nvoney,  for 
example)  the  term  zero-sum  is  clear.  In  our  case  the  proba¬ 
bility  of  detection  of  the  evader  may  be  considered  a  loss 
to  the  evader  and  a  gain  to  the  searcher. 

The  searcher  and  evader  play  the  game  according  to  the 
minimax  theorem.  This  says  that  the  row  player,  the  searcher 
sel.acts  his  strategies  to  maximize  the  raininum  expected  pay¬ 
off.  The  column  player,  the  ev^ader,  selects  his  strategies 
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to  minATnize  the  ituixiraum  expected  loss.  These  two  expected 
values  axe  called  the  lower  and  upper  value  of  the  game. 

The  mix  of  straitegiea  that  maximizes  the  minimum  expected 
gain  for  the  r^ow  player  is  called  the  optimal  mix  of  strate¬ 
gies.  This  assures  that  he  will  gain  at  least  the  lower  value 
of  the  game.  A.  similar  argument  for  tlie  column  player  says 
that  his  optimal  mix  strategievn  would  assure  him  of  a  loss  no 
greater  than  the  upper  value  of  the  game.  One  of  the  elegant 
features  of  game  theory  is  that  when  both  players  select 
their  strategies  optimally  that  tlie  upper  and  lower  value  of 
the  game  are  equal.  This  is  then  s imply  called  the  value  of 
the  game.  The  value  of  the  game  is  the  expected  value  of 
the  probability  of  detection  whexA  the  searcher  and  the  evader 
randomly  select  from  their  optimal  strategies. 

A  game  with  a  saddlepoint  occvirs  when  the  minimmn  of  the 
column  ma.ximums  is  «qual  to  the  maximum  of  che  row  minimums. 
Games  with  saddlepoints  aro  played  in  only  one  way.  The  row 
player  and  column  player  each  sselect  the  same  strategy  for 
every  play  of  the  game.  The  payoff  will  be  the  same  after 
every  play.  A  game  should  be  cheeked  for  i  sadd'J.epoint  since 
the  optimal  strategies  and  the  valr.e  of  the  game  formulas 
(that  we  will  develoo  next)  do  not  apyiiy  if  a  saddlepoint 
exists.  The  ootjinal  strategies  of  the  searchei'  and  evatier 
are  aeveioped  as  follows.  Consider  t!ie  2x2  giuo  s  (Eq.  A- 1 ) 
be iow ; 


Evader 


E- 


q  p 

*11 


12 


Searcher 


P... 


P, 


(A~l) 


where : 


fmd  are  the  evaders*  strategies; 

Sj^  and  are  the  searchers'  strategies j  and 

P.  .  is  the  payoff  by  the  evader  to  the  searcher  when 
the  searcher  chooses  strategy  i  and  the  evader 
chooses  strategy  j . 

If  no  saddlepoint  exists,  the  two  largest  elements  in  a 
2x2  game  will  be  a  diagoriai  of  the  payroff  matrix. 

Let  >  P22  ^  Pj_2  ~  ^^21'  payoff  may  graphed 

(Figure  8)  as  a  function  cf  the  mix  of  strategies.  The 
maximtun  expected  loss  by  the  evader  is  shown  by  the  darkened 
upper  line  segments.  Since  the  evader  plays  to  minimize  the 
maximum  expected  payoff,  he  would  pl.3y  at  the  point  vehere  the 
two  upper  lines  intersect.  This  means  that  he  would  play 
strategies  and  vj-ith  probabilities  l-Y  and  Y  as  shown 
in  Figvixe  8, 

To  solve  for  v  wc  equate  both  Lines  at  the  i !:,te rsect  ion 
of  the  two  straight  lines  whicLi  yields: 


SI 


Figure  9.  Craphi'''*-^'! v  ':;;c-*'.ving  for 

the  Searcher's  Strateaies 


The  solution  for  the  S'^archers*  probat»ilities  distrihutior 
is  analogous.  Tiie  payoff  is  plotted  as  a  function  of  the 
percent  of  the  searchers’  Si  .'dtetixes  .n  Figure  9  above,  Sir.ce 
't'O  searcher  is  piayir-j  to  uia.c.im/re  tiise  winimunx  payoef,  he 
is  reiving  the  gtaph  from  .oottca  up  (vine  evaders'  t  ;)p 

down,!  .  The  secircher  operates>  '-'t  t.n.e  j  ut-r-cection  of  the  tw, 
l.lntiH.,  This  ls>  the  asaximum  ot  the  raln:!.iaut^  sxpec'  :d  payvfxf. 


We  sol’  e  for  the  pj^oLi^hi.!  tries  of  tii'i 


by  equatxug  the  two  straight  I.anos 


he  ,1.0 . ^ii  o.ect'. 


y  .1. €1  i els  1 


X 


/ 


^11 

J"__fl2_ 

^11  "  ^‘12 

■^22 

P 

*•22 

^‘21 

^11  "  ^1,2"' 

“  P21 

^22 

(A-4) 


where  s 


1“X  =*  Probability  of  playing  ,  and 
X  =»  Prob2ibility  of  playing  S,,. 

The  value  of  the  game,  V,  is  tirie  expected  value  which  is 
determined  from  the  following  equation. 


V  =  (I-X)  (1-Y)  +  (l--,X)yp^2  +  XYP^2  (A-5) 

This  reduces  to; 


V 


^11^22  ■"  ^12^21 


11 


21 


H-  f 


(A -6) 


The  payoff  matrix  fully  describes  a  gcuae,.  The  valve  of  the 
game  and  the  probabilities  of  each  strat>^gY  are  a  function 
o  f  tire  . )  a yo  f  f  ma t r i  x . 

Var lance  of  a  Garae 

COP  ven  i  first  coiTtps.it  at  ion  form  for  the  variarrce  oi  a 
quantity  X  is 


h(X) 


Var  ( X) 


) 

.c. 


We  simply  compui:*;’  each  of  the  quantities  on  the  right 
hand  aide  of  the  equation  and  subtract.  The  game  G  is  das™ 
cribed  by  the  payoff  matrix  P  where: 


E, 


E, 


P  * 


11 


12 


21 


22 


and  Sp,  and  Ep  are  the  optimal  strsitegies  of  the 
searcher  and  evader. 


E(G^) 


SiEiPj^  ^  *  hVL  *  ^2^42 


E(G) 


'^1^1^11  ®1^'2^12  '*■  ^’2^1^21  ^  ®2®2^22^ 


The  variance  then  is  the  difference  between  these  two 
quantities,  i,e.. 


Var fG) 


E(G^) 


E(G) 


2 


R 


APPENDIX  B 


EVALUATION  OF  GAMES 


The  4x2  game  under  consideration  is  described  by  the 
following  payoff  matrix: 


E 


1 


E 


2 


S 


1 


S 


3 


a^4-a2 


0 


0 


a  ^+a2 


We  impose  the  following  conditions; 


^  ^2'  Aj,  ^  A^ 

and  make  the  following  substitutions: 

a, 

X 


resulting  in  the  hierarchy  6 


and  payoff  matrix 


0 

PrCE^) 

1 

Figure  10. 

General 

Plot  of  4x2  Game 

% 

^2 

a 

B 

^2 

Y 

0 

a+Y 

0 

0 

B-riS 

It  .3  nwre  convenient 

We  nc  ^  arbitrarily 

hierarchy  and  plot  the 

strate  /les  . 

to  work  with  this  general  matrix. 

cht  ose  a,  B,  ^  and  5  according  to  the? 

game  as  a  i':ur\crion  of  the  evader’s 

We  see  in  Figure  10  that  there  are  six  intersections  of  the 
four  strategies.  This  is  the  general  form  of  the  4x2  game. 
This  would  indicate  that  the  evader  would  solve  the  game  from 
the  top  down  and  choose  strategies  and  S^.  But  because 
of  the  partitioning  of  the  search  area  ajid  searchixig  effort 
and  the  definition  of  a,  Q,  y  and  6,  this  is  not  strictly 
correct.  We  will  not  solve  all  possible  2x2  gair^s  and  show 
that  the  lines  all  intersect  at  a  common  point  because  of  the 
definition  of  a,  B,  y  and  £. 

We  will  use  the  paired  notation  ij  to  indicate  which  pair 
of  the  searcher's  strategies  we  are  considering.  All  possible 
2x2  games  are  shown  below.  We  find  the  row  miniraam  and  coluxnn 
maximum  and  check  for  saddlepcints . 


t;* 

“1 


El  E2 


<i«4 


e  6 


13 


Si  « 


3  8* 


So  y 


a 


6  Y 

6 


S3 

a  +-Y 


0 

B* 


1  4 


3  3 


E, 


4 


K  •4-  A 


.,x  y 


El 


El 


24 


$2  Y 


B4-6 

3+6 


34 


a+Y 


4 


a+Y 


B+6  0 

0  +  6 


We  see  that  games  13  and  24  have  saddlepoi’its .  Mext,  all 
six  games  are  plotted  in  Figi  re  11  as  a  function  of  the 
searchers  strategies.  The  operating  points  (or  solutions) 
for  the  searcher  are  shown  by  the  he.aay  dots.  The  individxxal 
games  for  the  evader  may  be  cull  id  from  Figtxre  1  by  taking 
all  six  ]poasible  pairs  of  searcher’s  strategiew .  For  the 
case  where  a  ~  aL^/h-^,  0  «  etc,,,  we  will  show  that  the 

lines  all  intersect  at  the  same  point. 

We  will  solve  all  six  games  for  the  optiifnal  strategies  of 
the  searcher  and  the  evader  an<(  the  resulting  value  of  the 
game.  We  will  use  the  followiJig  notation; 


vltJ 

i:i 


1 


Value  of  tJhe  ^  ame  using  searchers  strategies 
i  and  j ,  and 

Pr, act  ion  or  e\’aders  strategy  K  played 
agarnst  searc  rjers  strategies  1  and  j  , 


w,her  e : 


1  to  .  1  ■( 

2  to  4 ,  L  ; 


ra  =  Evader  or  Searcher^ 

K  ®  1,  2, 


We  will  solve  the  value  of  the  game  for  both  the  searcher 
and  the  evader  against  S^: 


g  ~  B _ 

“  Y  +  6  ' 


-Y  +  6 

a  -  B  “  Y  ' 


E 


12 


+  5 


a  ”  3  “  Y  +  <5  ' 


,12 


g  -  Y 


g  -  3  “  Y  +  <5 


a6  ~  3y 

a  “  3  “  Y  hTT 


Against  there  is  a  saddlepc^int  game  with  value  3. 

Against 


a  ~  3  Q  _  3  ;<■  3 


•'->4  - 

a  +  5 

1 

g  4-  6  ' 

5 

r.14 

■■  (. 

a  + 

^14 

oJS _ 4  5 ) 

^4 

.  ^14 

O'*  ^5 

inst  (p 

—  -y' 

5 

■i.  t'  V 

:• 

J 

a  f  6 

-  .b 

4. 

a" . 0  ^ 

64 


E 


23 


a  T 


i:  ^2 


23 


_  ot 
a  +  5 


=s 

23  23 


V 


(a  +  y)  6 


23 


a  + 


Against  ,  there  is  a  saddlepoint  game  with  value  y 

Against  , 

J  4f 


01+5 


a  +  B  ^  Y  t  5  ^  3 


_ _ §  +  5 

01  +  ”5  5' 


.3A 


B  +  5 


a  +  6  Y  +  5'  ^2 


34 


a  +  Y 

5r-T''r'+  y“‘o"  ' 


34 


^4 


'34 


(a  _Y)  (3  +  5 ) 
ct  +  3  +  V  + 


In  general ,  the  evaders  strategies  are  not  the  same  for 

arbitrary  a,  6,  y  and  6  obeying  tne  hierarchy.  But  when 

rx ,  3/  y  and  6  are  defined  as  etc...  we  see  that 

,.,12  r^l4  .^2  3  ..34 

'•1  "  ■=]  ”  • 

,Siin.7.1arly  if  we  substitute  the  value  of  the  game  we  see 
that  V,,,  =  V..  =■  V.-,  ^  V...  This  means  that  the  uame 

,str.3.tt"‘gies  ail  intersect  at  the  Scime  pcj.nt ,  as  in  Figure  6. 
Therefore,  the  value  of  the  game  is  ( +a.,)  /  { A, +A.J  as 

■L  ,i.  L 


expected. 


APPENDIX  C 


CONSTRUCTING  STiIATEGIES 

There  are  four  independent  quantities  that  describe  the 
search  problem  with  two  searching  units  and  an  operating  area 
partitioned  into  two  pieces.  They  are; 


a 


A  ' 


^2 

and  6  ==  r— •, 

Aj  Aj 


The  searcher's  .strategies  and  S.,  played  against  the 
evaders  strategies  and  E2  yield  the  following  payoff  matrix; 


a 


The  searcher's  strategies  and  Sj  played  against  the  evader's 

strav  egie.s  E,  and  yield  the  foi  .lowing  payoff  roatrix: 
i  ^ 


■X  '  Y 


S 


^  4- A 


Strategies  and 
strategies  and 

6 (a+y) 

1 

aiS'-'^Y 

~Y(B+6) 


may  be  expressed  as  a  linear  sum  of 
S2  as  follou's: 

0 

B+6 


-B(a+Y)  a  0  a+Y 

a(6+6)  y  ^  0 
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